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© Electronic mosaic imaging process. 

© This Invention relates to an imaging system with 
computer-controlled, multiple electronic image acquisition 
and assembly means for producing a high resolution, 
large-field electronic mosaic image from a series of smaller 
field Image segments. 
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TITLE 

Electronic Mosaic Imaging Process 
BACKGROUND 

Field of the Invention 
5 This invention relates to an imaging system with 

computer-controlled, multiple electronic image acquisition 
and assembly means for producing a high resolution, large- 
field electronic mosaic image from a series of smaller 
field image segments. 
10 Background 

In the field of microscopy, a microscopist must 
select an objective lens that affords sufficient spatial 
resolution and photometric sensitivity to analyze a 
specimen. Having selected an objective, in many cases, 

15 the resulting microscopic field of view covers only a 

small region of the specimen. Consequently, in order to 
examine the entire specimen, it is necessary to move the 
microscope stage in a plurality of steps. A single view 
of the entire specimen, however, is necessary both for 

20 contextual appreciation and for communicating the results 

of the analysis. The classical solution to this problem 
has been to prepare photomicrographs of the fields of view 
containing the specimen and to assemble a montage or 
mosaic of the photomicrographs to present a view of the 

25 whole specimen. This procedure suffers from several 

disadvantages: it is both tedious and time-consuming and 
results in a final product that is either too large or has 
insufficient magnification. 

In current practice one often needs to acquire a 

30 video image of a microscopically-viewed specimen. 

Microscope video systems, by appropriate interfacing with 
computer-based hardware and software, permit the video 
image to be digitized and stored. Further operations, 
such as image processing and analysis, can then be 

35 performed on the digitized image. The present art, 

however, is unable to process more than a single digitized 
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microscope field of view at a time, which creates 
difficulties in analysis and display of the complete 
specimen. In addition, in cases where the microscopic 
specimen is only briefly visible, as in the case where 
5 rapidly-fading fluorescent tags are used, rapid, 

multiple-field acquisition is a necessity. Solutions to 
these problems have not previously been available. 

The present invention provides a means for the 
sequential capture and storage in a very large image 

10 memory of multiple digitized and frame-averaged small 
field image segments from adjacent fields of view. in 
addition, the invention provides means for matching the 
edges of the adjacent segments into a continuous field. 
Means are also provided for storage of the electronic 

15 mosaic image, and for real-time manipulation of the entire 
mosaic by the operator. The resulting composite digitized 
mosaic image simultaneously offers high resolution, high 
photometric sensitivity, and a wide field of view, while 
providing the advantages of electronic digital processing 

20 and analysis. 

BRIEF DESCRIPT ION OF THE DRAWINGS 
FIG. 1 is a block diagram of one embodiment of 
the system of this invention. 

FIG • 2 is a graph of a typical image segment 
25 sequencing plan used to form a mosaic image. 

FIGS. 3A-3H are flow diagrams detailing the 
method of the invention. 

SUMMARY OF THE INVENTION 
The concept of the invention herein described 
30 comprehends a computer-controlled, image processor system 
which automatically digitizes a sequence of magnified 
individual image segments from an object and composes the 
image segments into a single high-resolution 
wide-f ield-of-view mosaic image for recall and viewing on 
35 a CRT monitor. More specifically, the invention herein 
resides in a method for producing a high-resolution 
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large-f ield-of-view electronic mosaic image of an object 
within an object plane by computer-controlled, multiple 
electronic image acquisition and assembly means, which 
method comprises in sequence: 
5 a) selecting a field of interest within the 

object plane; 

b) defining the pixel size in the object plane; 

c) computing the number of image pixels in the x 
and y directions required to cover the field of interest 

10 in the object plane; 

d) determining the number of pixels in the x 
and y directions of each image segment; 

e) computing image segment size in the object 

plane; 

15 f) determining the position of each image 

segment in the object plane and the sequence in which the 
image segments will be acquired; 

g) positioning the object with respect to an 
image sensor so that the initial image segment position in 

20 the sequence lies on the image sensor optical axis; 

h) digitizing the field of view of the image 

sensor; 

i) transferring the digitized field of view to a 
contiguous set of x,y locations in a mosaic image storage 

25 means corresponding to the image segment position in the 

object plane; 

j) positioning the object with respect to the 

image sensor so that the next image segment position in 

the sequence lies on the image sensor optical axis; 
30 k) digitizing the field of view of the image 

sensor; 

1) transferring the digitized field of view to a 
contiguous set of x,y locations in the mosaic image 
storage means corresponding to the image segment position 
35 in the object plane, said correspondence being chosen such 
that the boundaries of adjacent image segments in the 
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4 

mosaic image storage means are in substantial abutment and 
al ignmen t ; 

m) repeating steps (j) f (k) , and (1) until all 
image segments in the sequence have been digitized and 
stored in the mosaic image storage means; and 

n) recalling the mosaic image from the mosaic 
image storage means. 

The invention also resides in a method of 
producing a graphical map from a stored wide-f ield-of-view 
high-resolution electronic image, the method comprising 
the steps: 

a) displaying a contiguous small portion of the 
stored wide-f ield-of-view high-resolution electronic image 
on a display monitor, said portion at any instant in time 

15 being within a display window; 

b) displaying an electronic visible cursor, 
superimposed on the displayed image, at a fixed location 
within the display window; 

c) roaming the display window within the stored 
20 wide-f ield-of-view high-resolution electronic image under 

operator control; 

d) generating mapping mirks under operator 
control from the fixed cursor position within the display 
window, said marks being stored in juxtaposition with the 

2r» image, made visible on the display, and roamed in 

coincidence with the image portion visible in the display 
window such that accurate juxtaposition of the marks with 
the image is maintained; and 

e) storing the x,y coordinates of the marks in 
a separate memory. 

The operator first selects parameters which will 
govern acquisition of the mosaic image, including the x,y 
coordinates of, for example, the lower-left corner of the 
mosaic image, correspondingly, the x,y coordinates of the 
35 upper right corner of the image, and the objective 

magnification. The basic pixel size in x and y are then 
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automatically computed, as well as the number of mosaic 
image pixels in x and y and the number of image segments 
in x and y. The computer-driven microscope stage is then 
automatically advanced to the coordinates corresponding to 
5 the lower left corner of the mosaic image. A video image 
of this field of view is then digitized, and a previously 
defined central portion (called a "vignette") is 
transferred to contiguous addresses within a large image 
memory which correspond to the lower left region of the 

10 image. The stage is then advanced by a distance which 

exactly equals the spatial extent of one vignette image, 
and the process is repeated in a predetermined path in x 
and y until the entire mosaic image has been acquired. 
Once assembled, the operator is able to 

15 interactively manipulate the mosaic image in various ways, 
including zooming and roaming, much as he would do with 
the live image on the microscope by changing objectives 
and manipulating the stage. The invention permits viewing 
the high-resolution mosaic image on a standard-resolution 

20 monitor by means of pixel sampling. For example, a 4096 x 
4096 pixel mosaic image can be displayed on a 512 x 512 
pixel display monitor using a sampling ratio of 1:8. 
Thus, zoom up to a one-to-one sampling ratio is achieved 
without the loss in resolution that would accompany pixel 

25 replication methods. 

A benefit of the method is that of preserving 
the high-resolution image of a specimen obtained from high 
numerical aperture (N.A.) optics over the wide field of 
view image normally seen through low power, low N.A. 

30 objectives. Another benefit of using high N.A. objectives 
is their improved light collection efficiency. Further, 
the invention minimizes the time that the specimen needs 
to be exposed to illumination. This combination is 
particularly applicable to those cases where the 

35 microscopic specimen is so light-sensitive that prolonged 
viewing of the live image through microscope occulars 
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would have an adverse effect on the specimen, for example, 
in the case where rapidly-fading fluorescent tags are 
used, A further benefit results from the fact that 
because the mosaic image is displayed on a video monitor 
5 by pixel sampling, the contribution of the camera's point 
spread function to overall image blur is significantly 
reduced and the displayed image appears much more crisply 
resolved. 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT 
10 The Imaging System 

For purposes of illustration, the embodiment of 
Figure 1 includes a microscope JL0_, typically a Nikon 
Fluophot, with an ultrawide Optiphot head 3^2 that is 
modified for mounting two standard format video cameras 14 
15 and 16. with the oculars. Video camera 14 is a DAGE/MTI 

Model 68 silicon diode array vidicon, and video camera L6 
is a DAGE/MTI Corporation Model 66 with a silicon 
intensified target (SIT) tube for low light level sensing. 
The outputs of cameras JL4 and IjS ar^s connected to the 
analog-to-digital (A/D) input terminals of image processor 
JL£, typically an Imaging Technology, Inc. IP-512 system 
that includes three FB-512 boards, two AP-512 boards and 
an arithmetic logic unit (ALU) board, which communicates 
with the other components of the imaging system over the 
22-bit Digital Equipment Co. (DEC) Q-bus 2£. Image 
processor 1JB functions to synchronize the input and output 
flow of digital image data, to digitize the analog camera 
output information, and to convert the processed digital 
data into analog form for viewing on display monitors Z4 
30 and 24A. Both displays are high-resolution color monitors 
(Mitsubishi Electronics of America, Inc. Model No. 3919). 

The microscope stage assembly 30. comprises a 
Nikon Diaphot stage on which are mounted two Burleigh 
Instruments Inc. IW-502 inchworm x,y micropos it ioners and 
EN-372 optical encoders and 36^. Stage controller 38^ 
comprises an Intel Corporation Model No. 8085 
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microprocessor for providing closed-loop control for both 
sets of positioners and encoders with I/O codes on an STD 
bus. The microprocessor is also programmed to communicate 
with a host computer system 4_0 over Q-bus 20.. The 
5 inchworm micropositioners enable the operator to rapidly 
and smoothly move the stage across its full range of 
travel. Typical performance yields 1,0 micrometer 
absolute accuracy on 2 axes bidirect ionally over a range 
of 50 mm on each axis. Both axes' positions are under 

10 simultaneous closed loop control, with position feedback 
derived from 1 micrometer linear optical encoders. 
Consequently, the stage can be moved and returned to its 
initial position with 1 micrometer accuracy and with no 
backlash. The communications interface with the host 

15 processor is able to support at least 150 coordinate pair 
updates per second. 

Computer system 40_ comprises: a DEC LSI 11/23 
computer which, includes Q-bus 20_; a 256 Kbyte main memory; 
a DLV-11J quad serial data interface? a Data Systems 

20 Design, Inc. Model No. DSD 880 30 Mbyte Winchester disk 

drive with a 1/2 Mbyte floppy disk; a Cipher Data Products 
Inc. M891 r 9-track 3200 bpi cache streamer magnetic tape 
drive; a Microline hard copy printer manufactured by 
Okidata Corporation; a Hewlett Packard 7475A six pen 

25 plotter; and a DEC Model No. DRV 11 parallel interface to 
the stage controller 38_. Communicating with computer 40_ 
is a DEC Model No. VT100 Terminal 42 . 

Image memory 510 and direct memory access (DMA) 
data-mover controller J32 (Image Analytics Corporation 

30 Model QD512) are hardwired circuits that communicate 
directly with the I/O section of the host computer on 
Q-bus 20 to speed up the delivery of image size and stage 
position coordinate data, with the result that the display 
of the respective vignettes on the monitor 2^ is rapidly. 

35 achieved. 



7 



01 99573 

8 

The image memory 5jD comprises a stack of four 
addressable memory boards, each with a 4 Mbyte (8 bits per 
byte) capacity, to provide storage for a 16 Mbyte, 4096 x 
4096 pixel image with full eight bits/pixel resolution. 
5 Datamover controller 52^ is a direct memory 

access (DMA) device capable of transferring data at high 
speed from a source address to a destination address on 
Q-bus J20. It is also responsible for selecting, as 
directed, an N x N pixel segment from image memory J50 for 

J 0 full display on the monitor 24 • 
System Operation 

In the operation of the system, the operator 
places a specimen on the microscope stage assembly 30 , 
selects a IX objective lens, and selects either the normal 

15 1A or low-light-level video camera 1_6. Live video from 
the camera is displayed on monitor 24_, and the operator 
uses this low-magnification low-resolution live video 
image to focus and frame the desired section of the 
specimen. The stage is then fixed, the image on the 

20 monitor Z4 is digitized, transferreS to a static frame 

buffer, and displayed as a low-magnification static image 
on monitor 24A . The operator then selects an objective 
lens with suitable resolution to acquire each image 
segment • The calibrated image pixel size DX and DY for 

25 this objective are obtained from a look-up table, and the 
maximum mosaic image size is computed and displayed as a 
rectangular mosaic image marker (MIM) that is drawn 
superimposed on the static low-magnification 
low-resolution image on monitor 24A . The operator 

30 manipulates, in this case, the lower-left and upper-right 
corners of the MIM independently to frame the area of 
interest. Once the MIM is set, the stage coordinates of 
the lower left starting position are computed, as well as 
the number and positions of full and partial vignettes 

35 required to fill the MIM, as schematized in Figure 2. At 
this point, the operator then may choose to eliminate 

8 
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partial vignettes at the right and top edges in order to 
significantly reduce the time required to capture the 
mosa ic image • 

Finally, the operator activates the mosaic 
5 imaging sequence via the VT100 terminal 42 . 

Automatically, computer £0 advances the stage assembly 30 
to a starting position and then steps it through a 
sequence of positions via stage controller 3_8* Each 
programmed position is precisely located in the center of 

10 its respective vignette. At each position, the acquired 
image segment from either video cameras ^4 or 16_ passes 
through image processor _18 to monitor Z4, which the 
operator observes while critically focussing the stage. 
Image processor 18^ then digitizes, frame-averages, and 

15 temporarily stores the 512 x 512 pixel video image for 

viewing on monitor 24A . A rectangular central portion of 
this video image, called a vignette, is transferred to 
image memory S0_ f as directed by the image DMA controller 
52 . 

20 The mosaic imaging sequence is complete when the 

assigned portion of the full 4096 x 4096 pixel image 
memory has been filled by the sequence of vignettes that 
have been acquired and stored in their respective image 
memory locations. 

25 To one skilled in the art, the following flow 

charts and description are sufficient to develop software 
needed to operate the microscope system disclosed herein. 

FLOW CHARTS 

Figure 2 is a representation of a mosaic image 
30 which has been resolved in into an exemplary sequence of 
thirty-six image segments for digitization and storage in 
image memory SO. Note that the sequence depicted starts 
with the first image segment at the lower left corner of 
the mosaic and after following a serpentine path, ends in 
35 the upper left corner. This particular image segment 
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sequence appears to be one of several efficient ways to 
proceed in that it minimizes stage motion. 

In the definitions following, the i, j column 
and row indexes are conventional right-hand coordinate 
system first quadrant descriptors and refer to a 
corresponding indexed image segment location in the 
mosaic. Fortran 77 syntax has been used to express the 
equations to facilitate their comprehension* 
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NVCOL, NVROW 



15 



20 



25 



30 



35 



NICOL, NIROW 



DX, DY 
DX * NVCOL 1 
DY * NVROW J 
DX * NICOL ) 
DY * NIROW ) 
IXBEG, IYBEG 



IXSTAGE (i) 
IYSTAGE (j) 

IXMEM (i) 
IYMEM (j) 



vignette format (pixels) - indicates the 
number of pixels comprising a vignette in 
the x, y directions respectively, 
(e.g., 340 x 320) 

mosaic format (pixels) - indicates the 
number of pixels assigned to store the 
mosaic in image memory. Given in terras of 
numbers in the x, y directions, 
respectively. (e.g., 4096 x 4096) 
pi.xel size (microns) - in x, y directions. 
vignette size (microns) - in x, y 
directions. 

mosaic size (microns) - in x, y directions. 

mosaic starting location (microns) - the x, 
y coordinates of the lower left corner of 
the first vignette of the sequence to be 
digitized • 

vignette location (microns) - the position 

of the lower left corner of the (i, j) 

vignette in the stage coordinate system. 

vignette location (image memory coordinates) 

— the storage location in memory of the 

lower left corner of the (i, j) vignette 

corresponding to values of IXSTAGE (i) and 

IYSTAGE (j) above. 

10 
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NXPIX, NYPIX - remainder pixels - the number of pixels in 

the x, y directions comprising the partial 
vignettes at both the upper- and right-hand 
edges of the mosaic. Specifically, 
5 NXPIX=ININT( ( FLOAT I ( N ICOL ) /FLOAT I ( NVCOL ) - 

FLOATI ( NICOL/NVCOL) )* FLOATI ( NVCOL ) ) 
NYPIX=ININT( ( FLOATI (NIROW) /FLOATI (NVROW)- 
FLOATI (NIROW/NVROW) )* FLOATI ( NVROW) ) 
NX, NY - total number of vignettes (complete or 

10 part ial ) to be recorded in the x and y 

directions, respect ively * More 
specifically, 

:COL/NVCOL) + 1, NXPIX > 0 
:COL/NVCOL , NXPIX = 0 

15 MV = f (NIROW/NVROW) + 1, NYPIX > 0 

:row/nvrow , NYPIX = 0 

Figures 3A through 3D detail the preliminary 
steps and Figures 3E through 3>H describe the automatic 
sequencing steps of the method that can be implemented in 
20 the system of Figure 1^. 

Steps 111 and 112 o f Figure 3h initialize the 
system and specify mosaic and vignette dimensions (pixels) 
preparatory to capturing a mosaic image • Specification of 
vignette dimensions in Step 111 eliminates portions of the 
25 video camera raster that suffer from excessive geometrical 
distortion. Choice of the vignette dimensions in pixels 
dictates the dimensions in pixels of the image segments. 
Steps 113 through 118 allow the operator to capture a 
low-magnification low resolution image using a IX 
30 objective, and to display the digitized image on monitor 
24A . This static low-magnification image will be used to 
allow the operator to interactively specify the location 
and extent of the mosaic image. 

Figure 3B^ shows steps 211 through 221 that 
35 enable the operator to: (1) select an appropriate 

microscope objective (step 212 ) and scale pixel size 
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accordingly (step 213 ) using a look-up table set of values 
obtained by prior calibration; (2) compute the maximum 
size of the resulting mosaic image that can be stored in 
image memory (step 214 ) given the pixel NICOL, NIROW 
5 parameters (previous step 111 ) and the selected pixel size 
(step 213 ) ; (3) display the computed mosaic (x, y) limits 
with a mosaic image marker (MIM) on the low-magnification 
low- resolution static image (step 215 ) y and (4) compute 
remainder pixels (NXPIX r NYPIX) (step 220 ) and establish 

10 the number of vignettes in x and y "directions (NX, NY) 
needed to produce the complete mosaic (step 221 ) . 

The mosaic image marker (MIM) displays the 
boundary outlining the mosaic on the static 
low-magnification low-resolution image on monitor 24A and 

15 is positionable on the screen using keyboard commands from 
terminal £2_. By positioning the MIM, the operator 
designates the lower left (step 216 ) and upper right (step 
217 ) limits of the mosaic for establishing values of the 
starting coordinates (IXBEG, IYBEG) and the coordinates of 

20 succeeding vignettes and for determining the total number 
of'pi"xels in the x and y directions needed to cover the 
extent of the mosaic image (NICOL r NIROW). 

Entry points 211a , 215a and 217a of Figure 2h 
are available to the operator to make changes to the 

25 objective lens selection, and to the starting and ending 
points on the mosaic, from choices detailed in Figure 3D . 

The steps in the flow diagram of Figure 3C are 
provided to enable the operator to make the decision 
whether the NXPIX and NYPIX remainder pixels need to be 

30 included in the mosaic. If these pixels are not needed 
(steps 312 through 315 ) , vignette processing time is 
considerably shortened. For example, with reference to 
Figure 2, should SNAP be elected (i.e., discard the 
remainder pixels) then the vignette sequence from the 36 

35 possibles in this example would run 1, 2, 3, 4, 5, 8, 9, 
10, 11, 12, 13, 14, 15, 16, 17, 20, 21, 22, 23, 24, 25, 
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26, 27, 28 and 29 (a savings of about 1/3 the processing 
time). On the other hand, should SNAP not be selected 
(steps 316 through 321 ) , then the full sequence of 36 
vignettes are recorded, with unfilled pixel bits appearing 
black in the digitized image displayed on monitor 24 . 
Step 322 provides an opportunity for the operator to 
change the input parameters should he see that the display 
of the MIM (step 315 ) on monitor 24A does not cover the 
region required. Recall that the MIM characterizes the - 
size of the mosaic image relative to the low-magnification 
low-resolution image of the specimen. 

Figure 3E_ shows a set of steps, including the 
use of two subroutines, that provide for the sequential 
stepping of the microscope stage 3JD on a serpentine path 
through the object plane of microscope 10^ and digitizing 
for storage in image memory 50^ a corresponding vignette 
at each step. After j=l initialization of a loop counter 
in step 512, step 515 tests to determine whether the 
vignette recording sequence moves from left to right with 
subroutine w G0_RIGHT" , step 517 , or from right to left 
with subroutine "GO^LEFT" , step 516 . Since j=l is odd the 

former subroutine M GO RIGHT" is selected. Similarly, the, 

next line is sequenced from right to left with subroutine 
"GO_LEFT n as soon as the (j) loop counter is incremented 
at the conclusion of digitizing the last vignette on the 
line. When the last row is encountered in step 518 , the 
process terminates. 

Subroutines GO_RIGHT and GO_LEFT are detailed in 
Figures ^3F and 3G, respectively. In Figure 3£, the 
vignette column counter is initialized in step 611 . Steps 
612 through 615 comprise a simple loop to acquire the 
horizontal sequence of vignettes. Step 612 tests for the 
final vignette on the row. If the current one is the 
final one, then steps 616 and 617 account for the 
possibility that the last vignette is a partial one. The 
GO_ LEFT sequence in Figure 3G is similar, with the 
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exception that the possible partial vignette is the first 
one encountered in this case, rather than the last. 
Both directional sequences use subroutine 
GET_DATA, Figure 3H, to carry out stage motion, image 
5 digitization, and data transfer to image memory. Step 811 
uses the (i, j) indices passed from the calling routine to 
compute the stage coordinates for the current vignette, 
while step 812 drives the stage to the computed 
coordinates. Step 813 computes the corresponding image 
10 memory x and y addresses. Step 814 allows the operator to 
focus the live video image on viewing monitor 2±. In step 
315 the image is digitized and in step 816 the vignette is 
transferred to the image memory with coordinates that were 
computed in step 813 , 
15 Once the mosaic image has been composed in image 

memory 50_ r it may be recalled for viewing and manipulation 
using a variety of techniques, including roam and zoom, 
contrast enhancement, false coloring and spatial 
filtering, or even automatic feature detection and 

20 analysis. The large high-resolution mosaic image can be 
stored on disk, requiring a storage capacity of up to 16 
Mbytes per image. An alternative for archival storage is 
a high performance 9-track tape drive system. 

In addition to providing means for automatic 

25 digital analysis of wide-field high-resolution images, the 
present invention also comprehends manually driven scene 
analysis, herein referred to as mapping. This method 
relies on the ability of the system to electronically 
superimpose" graphical marks over the electronically 

30 captured image. 

Note that if a given display pixel corresponds 
with exactly one stored mosaic image pixel, in general, a 
very small spatial extent of the mosaic image appears on 
the display monitor. This portion is referred to herein 

35 as the "display window" ; as noted earlier, it is possible 
to roam the window throughout the stored mosaic image. 
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The operator proceeds to create a map by "flying" the 
display window within the context of the mosaic image. 
Displayed on the monitor will be a fixed video cursor 
superimposed on the image, indicating the current . 
5 addressed cartesian coordinates in the stored image. When 
the operator so indicates, mapping marks may be 
continously generated from the cursor coordinates, 
analogous to ink flowing from a pen. The marks are 
displayed by replacing the image pixel value in image 

10 memory by a new value which is displayed as a high 

contrast color. Alternative means for storage of the 
marks is possible, for example, storage in the image 
memory bits unoccupied by image data or in a graphics 
overlay plane. The coordinates of the marks are also 

15 stored numerically as a vector list for further processing 
and analysis. Optionally, it is possible for the operator 
to indicate discrete objects by discrete rather than 
continuous generation of mapping marks. 

In addition to allowing mapping in the context 

20 of a high-resolution wide-f ield-of-view electronic mosaic 
image, it will also be appreciated that high-resolution 
wide-field images sensed and stored by any means 
whatsoever (for example, laser scanner, remote sensor, 
scanning electron microscope, or line scan camera) lend 

25 themselves to this method of electronic mapping. 

There are two sources of geometrical distortion 
in an individual digitized image. They are distortion in 
the camera raster and in microscope optics. Each of them 
must be made small for accurate matching at the vignette 

30 boundaries. Solid state video cameras offer low 

geometrical distortion, although many other devices for 
image scanning can be readily applied, such as, e.g., line 
scan cameras, laser scanners, and flying spot scanners. 
Plan-apochromat ic objectives appear to be adequate to 

35 minimize distortion. In cases where high photometric 

sensitivity is required, a high-sensitivity v id icon-based 
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camera (such as a silicon intensified target (SIT) camera) 
is appropriate. 

Since electronic mosaic imaging requires that 
the edges of adjacent vignettes be precisely matched, the 
5 video camera must be one that produces a raster that is 

accurately aligned with the translation axes and generates 
a pixel size that is accurately known. A shading 
correction may be needed to eliminate the edge effects 
between adjacent image segments, particularly if 
10 quantitative photometric density measurements are to be 
made directly from the image. 

Although the microscope embodiment described 
here: \ comprises a positionable stage with fixed 
micrc .cope optics, it may be beneficial under some 
15 circumstances to fix the specimen stage and obtain 

vignette positioning by translati g the microscope optics 
themselves. It will be understoo : that this method is 
within the spirit of the invention. 

Although the principle of this invention has 
20 bee i described in the context of a monochromatic optical 
microscopical imaging system, further applications of 
electronic mosaic imaging are envisioned, including other 
forms of microscopy, such as electron, X-ray, infrared, 
and acoustical imaging schemes, as well as assemblage from 
25 a non-microscopic two-dimensional image source such as, 
for example, a photographic image or series of images, 
thermographic images, or printed circuit boards. 

The method described herein has already been 
found useful for imaging a field of f luorescently labeled 
30 cells in which the labeled cells could be accurately 
discerned only by using high-magnification, high N.A. 
objectives, while the object field of interest containing 
such cells extended over multiple, high-magnification 
microscope f ields-of-view across the section. 
35 Another example in which the technique has been 

found useful is the imaging of receptor autoradiographic 

16 
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material in which the radioactive label covers essentially 
the entire tissue section, yet the grains in the 
photographic emulsion forming the analytical signal can 
only be resolved at relatively high magnification. 
Accurate distinction between the autoradiographic 
analytical signal and light absorption in the underlying 
tissue section requires this level of magnification. 
Thus, accuracy in the quantitation of receptor 
autoradiograms is improved by the method of the present 
invention in comparison with methods relying on a single 
low-magnification f i eld -of -view . 



17 



10 



15 



20 



25 



30 



35 



01 99573 

18 

CLAIMS 

1. Method for producing a high-resolution 
large-f ield-of-view electronic mosaic image of an object 
within an object plane by computer-controlled, multiple 
electronic image acquisition and assembly means, which 
method comprises in sequence: 

a) selecting a field of interest within the 
object plane; 

b) defining the pixel size in the object plane; 

c) computing the number of image pixels in the x 
and y directions required to cover the field of interest 
in the object plane; 

d) determining the number of pixels in the x 
and y directions of each image segment; 

e) computing image segment size in the object 

plane; 

f) determining the position of each image 
segment in the object plane and the sequence in which the 
image segments will be acquired; 

J g) positioning the object with respect to an 
image sensor so that the initial image segment position in 
the sequence lies on the image sensor optical axis; 

h) digitizing the field of view of the image 

sensor ; 

i) transferring the digitized field of view to a 
contiguous set of x,y locations in a mosaic image storage 
means corresponding to the image segment position in the 
object plane; 

j) positioning the object with respect to the 
image sensor so that the next image segment position in 
the sequence lies on the image sensor optical axis; 

k) digitizing the field of view of the image 

sensor ; 

1) transferring the digitized field of view to a 
contiguous set of x,y locations in the mosaic image 



8371 storage means corresponding to the image segment position 

18 
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in the object plane, said correspondence being chosen such 
that the boundaries of adjacent image segments in the 
mosaic image storage means are in substantial abutment and 
alignment? 

5 m) repeating steps (j), (k), and (1) until all 

image segments in the sequence have been digitized and 

stored in the mosaic image storage means; and 

n) recalling the mosaic image from the mosaic 

image storage means. 

10 2. The method of Claim 1 wherein the digitized 

image transferred to the mosaic image storage means is a 

portion of the field of view of the image sensor, said 

portion defining the extent of each image segment in the 

object plane, in terms of the number of pixels in the x 

15 and y directions, being called a vignette. 

or 2 

3. The method of Claim 1/wherein the image 

sensor is a vidicon-based video camera. 

or 2 

4, The method of Claim 1/wherein the image 

sensor is a low-light-level video camera. 

or 2 

20 5. The method of Claim 1/wherein ^the image 

sensor is a solid-state video camera. 

or 2. 

6. The method of Claim 1/wherem the image 
sensor is a solid-state line scan camera. 

7. The meth xms 1/wherein the steps of 
25 digitizing the f ield-of-view of the image sensor include 

frame-averaging in which a plurality of digitized frames 
of the same field of view are summed image-wise and then 
divided by the number of frames summed^ 

8. The method^ of^Claims 1 /wherein optics are 
30 connected to said image sensor and the optics comprise a 

light microscope. 

9. The method fo Claim 8 wherein the object is 
mounted on a computer positionable stage, and image 
segment positioning is accomplished by driving said stage 

35 under computer control. 

10. The method of Claim 8 wherein the object is 
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mounted on a fixed stage and the microscope optics, 
including objective, condensor, oculars, lenses, and the 
image sensor, are mounted on a computer-translatable 
second stage, and image segment positioning is 
accomplished by driving said second stage under computer 
control . 

. .. . any one of to 7 

11. The method of /Claims 1 /wherein optics are 
connected to said image sensor and the optics comprise an 
electron microscope. 

any one of to 7 

12. 'The method of /Claimsl /wherein optics are 
connected to said image sensor and the optics comprise an 
X-ray microscope. 

any one of to 7 

13. The method of /Claimsl /Wherein optics are 

connected to said image sensor and the optics comprise an 
15 acoustical microscope. 

any one of to 13 

14. The method of /Claimsl /Where in optics 

connected to said image sensor form an image on the image 
sensor of a two-dimensional, non-microscopical object, 
said object is mounted on a coraputer-positionable stage, 
20 and image segment positioning is accomplished by said 
stage under computer control. 

15. Method of producing a graphical map from a 
stored wide-f ield-of-view high-resolution electronic 
image, the method comprising the steps: 

25 a > displaying a contiguous small portion of the 

stored wide-f ield-of-view high-resolution electronic image 
on a display monitor, said portion at any instant in t'ime 
being within a display window; 

b) displaying an electronic visible cursor, 
30 superimposed on the displayed image, at a fixed location 

within the display window; 

c) roaming the display window within the stored 
wide-f ield-of-view high-resolution electronic image under 
operator control; 

35 d) generating mapping marks under operator 

control from the fixed cursor position within the display 

20 
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window, said marks being stored i„ juxtaposition with the 
image, made visible on the display, and roamed in 
coincidence with the image portion visible in the display 
window such that accurate juxtaposition of the marks with 
the image is maintained; and 

e) storing the x,y coordinates of the marks in 
a separate memory. 

16. The method of Claim 15 wherein the 
wide-field-of-view high-resolution electronic image is 
acquired using non-mosaic imaging means. 

17. The method of Claim 15/whfrein the marks 
generated from the fixed cursor position within the 
display window are generated in a substantially continuous 
stream, the stream being switched on or off under operator 

15 control. 

18. The method of Claim 15/wherein the marks 
generated from the fixed cursor position within the 
display window are generated discretely, one or more at a 
time, under operator control. 
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